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Overview : 



5 *> 



* • B '-, In Part I„ (Hannan. 1978)pwd argued for- a -stochastic treatmejg^o.f change 
- in quant it at ive* variables . We have already remarked that such al focus 



. V \ i- increases considerably the levt*l; of mathematical complexity. "Anything 

••.. 'V' ' , r." . . '■ \- . ' „ w " '■ 

rjfcl * * " " . I ' - / - . ■■ v V :£>*:-.-• • . ' J V'. 

^ ^ \ like a ful'l treatment of the issued exceeds bo£h our competence and the 

. ■• , * , = . . . ■ ■ i$ i ... *•''•«'' .*«..*.• 

■ needs of most empirical analysts, . Our goal*;' are more modest. We. wish 

<• • " ■ .- • 

t» lay the minimal .-groundwork for the^ statistical treatment of simple 



stochastic differential equations. We also seek to sfpteh some of the 
; _ continuities pf qualitative and quantitative analysis as they are 

-revealed in the study of diffusion processes* Our. discussion . / , './.; , 

provides an entry into the rapidly growing technical literature t We hope 
/ fto persuade .social researchers to come to, grips with this still-developing ■• 
field of mathematics, * f £ * " ■• ■ . m * 

We discuss two ' apprpaphes to the- stochastic study of change in 
ievels^^The first involves a seemingly innocent modification of the sort 
of- deterministic models treated in the last chapter. The scientist ■ ■ . 
assumes that the deterministic models hold only approximately due to a " *\ 

host of disturbing influences. It seems natural tp add a stocha.s tic element 

■ . ■ .. " - v _ \ - _ m - i .' ' 

* to tfai dif f erential equation to represent such noise, Th i s in vo 1 vo s- moving fronT 

;,; ~ - . - • - 

dY(t> . ^ f(Y(t), t) ' 5 ;' 1 

1 ' • »V dt . p - 

to " : dY(t) - f(Y(t)» ty+ £(t) v i 1 

- ' ; ■ >^ ' ' ' ' . ' ■ : 

■ where £-(t ) danotes' the ensemble of disturbing influences. On the view ' t& 
that fi(t) involves only approximation error and, isAlikely^composed of many. 
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3 



^dependent specific elements, one chooses J the simplest possible ); 



\ 6 k ■■■■ f ; ° ,il 

structure for e (t) * The overwhelming ..tendency is totreart e ( t) • , , "V '■ 

tfs^a so-called /white/ noise ; or fd e 1 1 a- e or re l?at ed stochast io 'pCpcess , ^;Thp • i 

study o£ the; properties >; ofydif ferential equations "driven 11 by white' no isp 

is the central problem in the "analysis of stochastic differential equations* 

(BDE's ),; ' / - • '". ; \ < ;,. ' ■: ; ^ , ;■ . . ^ ' - : \ ' 

The Second motivation employs the logic of probability. As we f 

mentioned in' 1 P^art I , ; -changes in levels may be considered as the ; limiting 

csLse- oE transitions**^,, an infinite state u spaee of discrete; states , ; where 

the limit is approached by decreasing the ''width" of ea^h. .state. For V , , 

example, early progress in the; theory of Ma^koV diffusion processes , : 

considered random waits on the real line as the limiting caa# of the . 

discrete-state random walk encountered * in most elementary probability 

texts. As the early interest in such analysis of Markov processes , in ■ ' 
* :'•.=:.•:. '• ' • ••• " ; ; A • 

continuous state spaces (and in continuous time) arose f jrom the study of 

physical diffusion processes*, the term ,dif fusion process has come to be . ■ 

applied broadly to these processes . . — • 

'"■ The elementary parameters in the study of diffusion processes are 

rates of transition just as in uhe discrete-state case considered earlier. 

Substantive hypotheses enter as restrictions on transition rates. The 



goal, as in the discrete-space case^ is to formulate and solve equations 



for the evolution* of probability transition densitia^A Then one may evalu- 

ate the effects of various rate parameters on the evolution of the ^process* 
The approximation perspective- is the typical mpdal of* entry of' the 



substantive modeler, the diffusion perspective has -more appeal to the 



r 



"•'*= •. . • * ' ' '-. . ■ ' ' ' 

4 mafehe^ati 



perspefcoi 



/ 
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•r 



fact, ^kny ! f undaS^iit 



tly - the. former is often referred to as the physical 

-^•--•-.-^ -.^.-_-.-.-..-^-.:'---^;.. T -.-:-...... -- . 

ve while the latter is -called the mathematical 
perppec tivesrare no/t that sharply different. In 



Issues in the study of stochastic models for 



changes levels c^&ern "the relationship between the two perspectives, , 




Idetfn the relations .between stochastic differential 
n equationsu ' . *■ M 

k . v. *>i :< -'r.-., ' , ■'• ■ „ •'' . \ ■ 

e chagter as foiXows,* 'In Section 2 we state 



f he properties of white noise proppsses and thesar&lated Brownian motion 



process . .Section B discusses SDK's and the two approaches to 

* " / / " . ■ . "[ " i" .' ' . • 

solving them* > Inject ion t 4 we derive Kolmogorov's diffusion equation 

and give results relating parameters of, SDfe's to those of diffusion equations, 

( . _ . . ' " ' * ■ , v ' ■ 

We also 'give - remits on 'conditional densities that will be used in subsequent 

;i '. 4 / j , % 

chapters. Section^ ^ 5 treats aj substantive example , population growth 

in a random environment, from* the two perspectives. Finally, Sections 

raises the problem of the behavior of Markov diffusion- processes at 

boundaries (e.g., the .complications that arise -in the study of bounded' 

process^ e.g., those that -are def ined^ to., be nQn-negative ) « 

2 White Efoise and Brownian Motion '• - . : - . 4 • 

, . . \ ': ;7 . : ■ .. ', ■ • . * : . . ^ \ 

As we mentioned above, substantive applications of SDE models almost 
invariably /use. a white noise disturbance (or " forcing function) . "Since this 

ehoicy implicitly defines a stochastic ptocess for; the .substantive outcome s 
it is important to understand the properties of systems driven by white noise 
processes. We begin with the white process itself. ■ ? 
V ^ There ^re a number of approaches "to defining a white noise process r / 
One strategy (see Ja-zwinski 1970:81-83) begins wi thW Sistrete t ime ; * . ' 



,7 

/ 



process, Consider a - random sequence jjX^lii'/" 1,2, . . with inde pendent 




1 



inorements* \ / , . * ,- jf-- 



V(kr> 1), ' • ' . . 

This process "may be thdflfeht of 3.s being pure noise; knowing the, history of * ■/ . ' 
^he process and its current value does not aid" in predicting its future, ^ ) 
In substantive applications, each realization *of {X^} may be con- , 
sidered to be the sum of many independent forces; in technical terftis , the ; 

- ' - VV " '" v r . • \ " 

sequence is tshe superposition of many independent sequences , If sp, the ;* 

central limit theorem applies and (x \ may be considered Gaussian or •/ * 

. _ L n i 

normally distributed. So in discrete^frime analysis, white Gaussian ■ /. 

sequences .give a very simple specification for the effects, of omitted 
variables s one that agrees closely in spirit with the specification - 

• . ",. ' • ' i - 

usually used . in static analysis, \ 

. *■ » - • • ' 

With this background it seems natural to 'define { a continuous -time 

' * ■ - I " - 

analogue to white Gaussian" sequences for use in forming JSDE's* Thus we r 

h * ■ . . . , ■ * r 

define a white Gaussian process {X. i t e T} ? with independent increments : 

• t * w 

Perhaps tin: most informative appr^cK to this process is through its correlation 
functions Y(t + T, t) - E (% t+T x t ) . Suppose c^e process has zero me"an 
and correlation function given by , * - " , 

•. .^>' "Y p (t + t, t) = a 2 (p/2) e" p,T| , . ' \- ' / (1) 

For Targe p, thi/'function- approxima'tes the pfoperties we "Besire for , ' 
the white* Gaussian process. In particular, fo* large p the correlation . 
function is %r,y small even ov|r brief intervals. If P is restricted to the 

V >' ' . . .. ' 

\ .• ... .. . • .• \ . j ' .\' 

, * - v . . * . ■ ■ . . ■ 



6 v ; ' 



; A ■ 

4 'if 



5 ■ * ■ 



irite 



see 



pi ■ 2 - 

gers, the sequence {y /a* M > ^ > •"••} defines the Qirac delta function 

Braun 1975 1 325^35) t This ^funct^on, depoted <5(t - t) ? is zero, everywhere 
I 



is 1* It is not of course an ordinary j^nction ? but treating ^t as if 
it we're/* has 'g^vefif useful results in the study of impulse function si And 
we/can view white' Gab^sian noise as just such ^fe impulse function, \yThat is, 

1 li 1 & » 

thel noise process consists/ of a great many independent impulses or shqeks>^ ^ 

" ■ & * ' a! j • ' -J i 

that each hold fpr only a'.brie^ instant, ; . ' ' " • . 



„ . ' thus* we define a white Gaussian process ' as a Gaussian pieces # with 

E ^(X t 4cEIx^)(X t ,- Q(t) 6(t - J) ? i ^* 1 (2) 

where QCtr) 1 -is a positive semi4^^plte covarianee matrix and \6 (t - T) 

; • ■ * ." f ■ . ' ■ ■ 

is the Dirac delta function. 4 -This L process is usually "referred to as 

white pj^se or "li a delpa-correlated process ^ * Note th^ by the definition 

of the Je It a- function,, white noise has zero covaraance^but infinite; - 



variance* 



4' 



, We 
related 



tan obtain, additional insight into this process by considering the 

\ /' ~ y - ; ■ • " .... -. ■ 

Brownian motion or Weiner pr^q^ss. This, widely % used process is namAd^ 



after Jtobert Sr own, the Engl iih botanist *who discovered 



movement 

' foriftaliE 



of pHarticlars suspended in a solution, and Norbert Weiner, who 
ed^ the model of the process. It is .discussed in mast texts on 



^Bro 
followinl 

i 



regular 



stochastic processes, e.g., Karlin and Taylor (1975: Ch. 7), ^ 



wnian motion i§ a sjochas tic ^process f {X<t) ;'*t"^ -0} with the , 
g properties: , , 



Independence', X(t + At)- X(^) is irfaependsrit of;|{X(s)} 5 



r - t; 



-that is increments are independent a^" the e|\tir&^^^£^rv of the 



process. This assumption . is It&onger ttiaa the Markov assumption 




/ 1 



and implieg it, 
■ i , 



j" 



1 ,,>' 



* f 



,4. • ) 

(H) ftationarity; The^Jlstribution of X(t. + A^) - X('C) does not 

J , - 

depend on t. 

(ili) Continuity: 1dm ; ■ At 



At 



e > 0 



Than if X(0) = 0 it follows that increments in the process, X(t + At) -^C(t). 

are normally distributed with mean M«t and variance C7 t . 

. " " * ^ ! ) _ ■ ' ■ . * 

(Jsee Breiman 1968 : 249^50)^ And, any Brownian motion procass &ay be 

transformed into a standard Brownian motion^ whicfer-*is normally, distributed 
* with mean iero and variance of pne. The: correlation, function for the process 



is given by 



A' 



(3) 



Y(t, T ) "fc 9 min (t, T) . ' . , 1 

/ 1 J'' : J ■ V .' * . ■ ' 

J ■ . ■ v ^ . , A - 

That is s its autocorrelation 'depends only on the. time separating the realizations* 



This process has obvious' appeal: normal ity|' follows from very simple * 
(but strong) assumptions .about the , process- and tjie first .and second moments 
ire simple functions of**elap#ed time , However s -this process has sdhe, odd 
properties* .Though sample, paths of the process iare eontiriuou^ with ^ 
prob ability one £wpl) it is nowhere dif refehtiable "wpl. nor does it have _ , 
bounded variation wpl (Boob 1955 * 393) , , ( . if 

. . . . L. . 

Fihally^we consi4er the* relationship between wh^ie, ,no%se and Browman 



% 4 



I ' it / ' 



motion* Le 



denote -a Brownian motion process a 



nd{w(t)} 



a white 



se , 



V 



Though we know — ^ does not,, exist , pretend for, the montent that it does, ; 
w i at 

' . . . ' f * 2 

Then it follows (see Jazwinski 1970-85) that, white noise is Ithe formal 

• . .. , * ; / 



erivative of Brownian motion: 
n r 1 



t 

V 



1 ^Recall that-^ ""-is <W(ut, at) when 8„ ■ 0. On The ' formalism in (4), w-(t)' 

■ ' . 2 > '.*: * 

is N(u, G )» or in the case ©t standard Brownian motion, N(0,1)- However, 
we have already seen that white noise has infinite variance. ' Thus the . 



0 
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o 



r - . t *■ - . i • ■ 

- 1 * . : > ■ . 7 



S f ormalismV though suggestive, does no^ serve as a basis for consistent 



mathematical analysis ., 



3* Stochastic Differential Equations 



e now turn to properties ©f process'ej driven by wjjite noise pr 



" (A 

Brownian motion. We begdn3wt%h* a^ very famous special aase, the Ornstein- 
Uhlenbeck (6U) process. Brownian jffitftio^as a description of the moveriient 
o£ particles, in some liquid is particularly unrealistic, in that it assumes' 
that increments are independent/ TMis amounts' to .ignoring the effects # - 
of 7a particle's velocity* The OU process cotrects "this in a straightforward 
w^y (see Cox an£ Miller 1966 1 226^30; Brienym 1978; 347*51). 

Let-Y s (t) be the^ velocity of a particle of mass m suspended in 



uid and let mAv(t) be the change in, momentum' during the period. Jjfhen 

^mAVCt) -■-•PV<t)At * Ara(t) . , * ' * C5) 

where" "Pv is the viscou's resisting force and Am 1b" the change in momentum * 



due to random impacts with neighboring particles fa As*A- v first approximation, 

" ' .' ; " ^ ' . \, . „ , 

one may consider Am to be a Brownian motion, If there is np drift (see * 
below) , we B^y write -the OU process as 1 fc -~ 

\ - ; 

#» t ^ .. „ 

. mAV(t) = - 0V(t)At + CJ&B \ m • v 

f t " ' * ■ ■ 

'Where P is a standard 'Brownian motion, - ■ 

.. , .. * * #* 

/' The usual next step in, such models is/to divide by At and let At -> 0 



giving /. \ \ 

'• C ' N . 

m d_V(L) • - ^V(t.) )• ; .d3 ( , (6) 
dt dt • ' . . 

■ . [or m dVTt ) = - PV(*t) + Ow(t), where v/( t ) Is white noise; see (4)] 
dt ' { . •' 

/ SI 

' • , ' —" 
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■ ,• ,: . , J 

,IJnfM:Euiiat^ .... 



not have an s orthodox meaning. Suppose we ignore this and {?ush ahead « 
using formal rules? Following Brieman ^1968 -348) write (6) as 

,, ' ' d c e at v(t)) T^fft . " . . \ ,<7>y 

4 where Of = P/m 5 V ^ °/m* Assume V(0) - 0 and integrate from CT to t to 
obtain 

; ' • / • \. ^ 

' e^V<t) = Y J* e" dP - ' ■ (8) / ( 

• - : ; S ' . 

Doing an integration by parts Ogives 

' - • ■ J 

e ttt V(t) - Ye^P -'\bf J P. e al ds " (9) 

■ 0 s ' ' ' ' 

' * - * . 

Since 0^ is 'a continuous function (wp^) ? the integral in (9) for any ' 
realization 7 ! is just the integral of a continuous function and is thu^well 
defined, 5 Thus the process given by^y 

" - . — . . tr v _ \ - . \ . < 

N> V(t) - Y-J a 0 ^" 8 ' dp , , ^ ' ■ (10) 

■ - s 0 s ^ ■ 

can be well v defined by this procedure and results in a process with .continuous 

* * * - 

sample paths, The integral .in (10) is termed a stochastic model* ** *' 

' ■ t * . ■ # 

So we find that overlooking the mathematical pathology of Brownian , 

motion hnd proceeding with formal rule© gives a reasonable . result for" the 

OU process . we will see below, this true whenever the SDE is linear* 

that is, when the parameters of Brownian motion disturbance do not depend on 

the state of the process. Results on this special^ case are particularly useful in 

'estimating models of* the sort discussed in the previous chapter. To show 
/ ■ '-, . , © 

this, all we need to do is add "drift" that is a function of one or more 
? t 

» , jj- * .. 



10 . ... 



* exogenous variables* Letfus start a with ah 00 ' process W , 

AY(t) * PY(t) At + M» At + CT6P t 



and let M^^f (x) where x is* some exogenous variable. Then, as above , we may 
write this aj 

> . dYft) ^ = PY(t) + f(x) + a dB .... ■ (i!) 

c dtf dt / 

This has the ^ge neral form of the linear differential equation models 
witfh causal variables discussed in the previous' chapter, ^And it is now 
Clear that tp understand the stochastic p^bpertie^ of Y(t) we must consider 

the distributional properties of such stochastic integrals. . 

Before considering stoc^tstic integrals, we* pate the general problem. 

The genera^, -first-order. SDE has the form ' • ' . t : • 



1 '. . * 



dY(t) - f(Y(t),t) dt + g(Y(t),t) dB * (12) 



. As we have seen, because^ of the pathology of Brownian. motion, such equations 
dp^ not have any orthodox meaning. For .this reason, it is usual to reverse 

': " »V, . , - , * » 

the classic procedure in the calculi in which integrals are defined in 
' ' ' * - 

' terms, of derivatives" (as anti-derivatives) and tg define (12) as the 

■ " " • ", * ' ■ — — ' 

in t e g r a^lj^eq ua t i Qn . i " ' *v f " \ 

i ' ' - * 

/t - , t • / , . % ■ ■. 

Y(t).- Y(0) = .-j f(f(s), s)ds' + j. g(X(s),s) dP \ , (13) 

■ t rt t s 

Q 0 

i 

That is, the SDE is defined in terms of thAstochast ic integral,. Thus so 
Interpret the properties of Y<t) we must consider the existence, uniqueness, 
etc. of the general stochastic integral 

J >'.. ' ') dg' 

■ ■ s 



(14) 



where g (^) is a random function. 

- s 




Integral a such as (14) caanot be^ def ined for sample f unc t Ions (that is 



wp 1) .because" of the peculiaxJJtJgf of Brownian motion mentioned above* Thay 
ha^e f however, bean defined in €h& mean square sense by<Ito- (1944) and 
Stratonovich (1966), 'The sequence | J" is said to converge in mean square 
to Xjif l[iX n l 2 } < « for all n, E (ix I 2 } < 0 s and * 

lim e(i.X - L 2 | f 0, 



in which case we write l^i, m. = X This form of convergence implies 
convergence in probability (the plim convergence so commonly used in 
structural- equation analysis) imt is" slightly weaker than convergeneeTNaj^th 
probability one, A vary clear statement of the mean square calcuius is 



'presented by Ja^winstfi (1970:80-70) 

We^ consider first the t general Ito definition of the stochastic 

■ ■ ** * . ^ 

integral (14) . We rely on the treatment in Jazwinski (19 70) ;^the 

classic treatment is by*Doob (1955 : Ch . IX) . Let T = [ a,b] and let 



K> is T l 



t e T { bp a scalar Brownian" mot ion -pyMcess with- Var 0^) = a 



ition T such that 



a " h < c i 



j^and consider the step functions 

0 t t 

.8i (») 



0 



* g (<*>) - 

. " t 



t; * t £t. 

i " .1+1 



Where g . (u>) is - independent of { P - P - t . < t 1 < .t ■< bl and e{| g. (w) t ) 4 
is finite, / F( i r suctv> step functions the, IfcS integral is defined as 
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/ g,>) cit3 ( ftT «.C«)(i\ H ) — , •'. (15)- ^ ' 

; f ~ C 4 , v'W 51 C i+1 C t ■ . , J. . 

By the. independence assumption - ■ , 

• ' . - * : x * 

-If f^Cuj)^ is another^^tep function with the above properties (see" Jazwinski 
'1970:38)'. ' - * ■ ' * 

E^J" g t (w) dP t ^ 1, £ t Cu)) dP c j - a 2 j gjg* f^dt . . ■ * i (17) | 

i , 4 ■ 

. That is 4 under the expectation operation, stochastic integrals reduce to 

ordinary Integrals, (integration with respect to t rather than with respect 

to M^) * As a consequence 

*B.jjT I t (^ de J StW^t] r ° 2 J Z t (W)2 dt * • . (18) 

■ -■i Since we aTe not interested in step functions per se, consider a 
sequence of step functions (with successively finer cuts in T) , g"(<*0 - 
Suppose these converge in mean square "to g (w) . Then it follows that 

f g ' (<i)) dp - 1, i.m. J g^Cii) dP t (19) 

Doob (1955) has shown that this mean square limit exists for a very broad 

class of functions. More generally, the Ito integral can he defined as 

the limit of Riemann-Stielt jes sums. Let P be the max ( t 1+1 " c i ) in the 

partition of T. Then the Ito stochastic integral is defined by 
n-1 

r 

gr ..(«,) 0^ - ) = ( g r (^) d^ (20) 

p=*0 i=0 



l.i.m. L g r "(ui) (B - 0 ) = ( g { 
p-0 i-0 .. i i+L i J T 

A concrete example helps show how this definition differs from that 



of the usual Riemann integral, Let g (*>) ^ - Then (see Doob 1955:443) 



(B - P.) dB = ^ (8 - S ) 2 - 2 (b a 1 ) (21) 

t a t D a ^ 



Xjjote that the usual rules of integration would give only the first term 
on the right 'hand side of (21). 

Stratonovich (1966) proposed an alternative definition that is 

■ "* 

somewhat more specialized, Whereas Ito 1 s definition holds generally, 

Stratonovich 1 s approach is M \ . , just versatile enough to handle stochastic 

differential equations" (Mortensen 1968:287), In "particular, g t 0*O must 

be an explicit function of 1 

If as before we let P = max (t . , - t . ) in the partition, the 

i-rl i 

Stratonovich stochastic integral j.s defined as 



Consider the example just discussed^ It turns out that 



t a t 2 b a 



a 



which agrees with the usual rules of the calculus. This holds 

generally: the Stratonovich integral can be evaluated by the usual formal 

rules. 

The' difference between the two approaches is one of definition. 
And there is not yet any agreement about the comparative advantages of 

a 

the two approaches for substantive work. Mathematicians , of course, 
strongly prefer the Ito approach because of its generality, Substantive 
researchers are attracted to the Stratonovich approach because it retains 
the usual rules of the calculus. This is an especially appealing feature 
to those who consider the white noise specification to be an approximation, 
If ohly an approximation is involved, it does not appear fruitful to tlcvinc a 



new calculus out of concern with the ^pathological nature of white noise. For 
illuminating discussion of the issues involved in choosing between the 
two perspectives , see Gray and Caughey (1965), 

-We' began this section with the OU process s an example of the important 
special case of linear stochastic differential equations: 

dY(t) - f(t) Y(t) dt + g(t) dp . (23) >■ 

Note that g(t) is not a function of 3 . Whenever the disturbance has 
this linear form, the Ito and Stratonovich approaches agree and there is 
no debate whether the stochastic integral can be manipulated with the 

usual formal rules; So as long as we restrict our attention to this special 

3 

casje, much of the mathematical complexity recede s\ 

For the linear case % the integral form is , 

t t 
" Y(t) - Y(t Q ): - f fCs)Y(s)ds + J g(s)d0 g . (24) 

if * I 

If Y(tg) is Gaussian, that is the initial distribution is normal, or 
Y ( t q ) £0 , the process Y(t) is a Gauss-Markov process, We can use 
this facf anH the rules for* taking expectations of stochastic integrals 
/16) and (17) to derive the distribution of the process. 
We have discussed estimating linear models such as 

dY(t) - adt + bY(t)dt + cXdt + vdB (25) 
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v. 

'Because of the linearity of (25), Y(t) ts Gaussian (if Y(t Q ) ^ Q or 
4s Gaussian). To find, its /mean and variance we solve (25) by formal 
.rules to get 

Y(t) ■ - (e -1) + e Y Q A + g (e -1) + & (t) U&) 
t ; 
where * B(t) = sj e b ^; s) d^ (27) 



fc 0 



and At = t - t . Clearly E(6(t)) - 0 by (16)/ 

And . t t 

V ar(e (t) ) - E e ( t) 2 - a 2 E f e b(t "^ d& fl J e b ^ s) dP e 



which, by (18) is aqua! to 

' e 2b(t - s) da = o- n..,.-- bAt ) (28) 



« 2 J 



2b 



Thus the process { Y(t)} has "disturbance" £(t) ~N(0, o*), where a* is given 
by (28) . We will use this and other similar derivations extensively 
in forming estimators in ^he next chapter. 

We will return to non- linear SDE 1 s in Section 5. But next we 
consider the second major 1 perspective on continuous -time , continuous state- 
space stochastic models: diffusion processes. We will first derive 
diffusion equations and then discuss their relationship to SDE ' s . 



Lb 



h5 



*4. Diffusion Processes , 

Just as in the analysis of discrete outcomes wish to write 
expressions for transition densities and for the changes over time in 

( • ' 

transition densities. Since we have introduced Rrownian motion distur- 
bances or forcing functions, we have turned Y(t) into a Markov process. 

And it seems natural to search for the relationship between the qualitative 

•J 

and quantitative case by considering Y(t) as the limiting case of a^ 
finite-state Markov process where the states are made "infinitely small." 
That is, define a birth and death process on the real line where states 
are non-overlapping segments of the -real line. Then let, the width of 
segments go<^o zero and study the behavior of the stochastic process^ 

The relevant analysis is sketched by Go.el and Richter-Dyn (1974: 33-34) 
--see also Feller (1968: 354-59) . Consider transitions from n to n + 1 

i 

or to n - 1, births and deaths, respectively and assume that the 
probability of a birth in (t,t+At) is At + o (At) and the probability 
of a death is u n At + o(At), The procedure for" passing from the discrete 
mode.1 to models like those discussed in this chapter involves introducing 
a small parameter h. Let x ~ nh, Xq = mh and P m ^( c ) ~ p (Xq , t^; x 5 t), 
the probability that the process has the value x at t , given that it had 
value x at' t Q . 

Next consider a 'sequence of birth and death processes with h - 0 

with transition rates & (h) and u. (h). We have 

n n 

h[\ (h) - M- (h)T - a(nh) + o(h) * (29) 

n n . 

h 2 [A (h) - M- (h)l - b(nh) + o(h) ' (30 1 

■ n n 

where a(nh) is finite, b (nh ) is positive and 1 i_m u >(h) - q . 
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^ T^e forward' equation for the discrete-state process is ' - ' 

\ . 

V 

dpjm(t)- ^ X 1 p ' . (t) - (M* + X. ) p (,t) + [L ' ' p t , (t) QlV 
-> ' n-1 ijm.n-l* x n n r mn n+1 r m s n+l w ' 




Now we rewrite (31) as follows, ^ 



■ * + ti + Vi ) ^ !X - h ' t) flliVWp¥o ; ^ t » 

• , . r . - ' 

(A „-1 " 1L n-I> ' )(:: 0' t ,) ; - h - , '"| ' • 

Letting h=*G andgtrsing (29) "and (30) gives one of the fundamental 
equations o^rthe process: *' i 

f '" i a 2 ' 

/ a^--^ [a(x)pj += T-2[b(x)p] ' • (.32) 

dt dx * _ , 

where p - p(x^ , t^ ; x, £*■).'• This is called the KQlmogorov forward equation 

(in physical applications it is .often called the Fokkes-Planck equation). 

The so-called backward variables K Q?tg ara essentially constant and enter 

through boundary conditions. Since this equation t^akes the initial con u 

dit ions as given and generates the future of the pVocess, it is the natural 



17 t 



approach tq^ Substantive modeling, By similar prooedures we can obtain 



y 



the backward 'Equation : r ^ 

■ j Q- 1 i u * \ ^ u ■ - ^ » 

in which the ^o^tcom^ is .treated as fixed, Thougrj this equation does not 

■ ... k " 

appear v prtai sing * for "m#de ling [since causation goes backward in'a^ense] 

V ].■' • , » 

it s imp iif re's certain analytic problems and is particularly well suited for 

e study ofebbundary problems^ first passage time* distributions 5 etc, 
Thu^ the backward equation plays a prominent role in mathematical treat- 
ments of diffusion models, t j » , 

Eithat pf the Kolmogorov equationsX provide a complete probabilistic 
description of the evolution of the phenomenon. They tell how the^meanj and 
variance (and other moments if they exist ) change over tin^fi They give 
steady-state dis tributions ? if they exist. With appropriate boundary ^con- 
ditions,* they also permit study of the distribution of times for first passa 
past some level (e,g i? extinction of a population)* Unfortunately 
it is very difficult to solve. these partial differential equations and 
this has been done only for a limited 'number of cases. Various known 
solutions have been tabulated by Goel and Richter-Dyn (1974 -52-3) , y > 

si *. ■ 

. An obvious question concerns the relationship between the diffusion 
parameters, a(x) and b(x) (or aQO, b(x Q )) and the coeff icientsl of SDE 1 s , 
To address this question we need an interpretation for a(x)^(hd bCx) in the 
diffusion equations, 'The first, a(x) , is the rate of gro wth of the mean whe 
the stochastic proceHS is at x: 
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■ I 



a(x) « 11m .- 



t •{) 



J*(z-x) p(x. 0 . ! t 0 ux ) t)ds 



1? 



where Q is the state space of the process. And,' U(x) is the rate of 
' . growth in the variance of the process when it is at x< . , ! 



b(x) ■ jjm ip' C (z-x) 2 p(x 0 ,t 0 ;x J t)d; 



(35) 



* * 1 . . \ • -J 

f r , 

•The relationship between the two sets of . parameters is particularly ! 
simple under the Ito interpretation of the SDE* ^Then (see Doob 1953: 
273-7), a(x) - fCxOO.t)-, b(fO - g(x(t),t). ^That is, if |X(t)j'^0) is, 
a Markov process sufficiently regular -for ' (34)^and (35) to hold* then 
the solution of i 

dX(t) - f(x(t) f t) dt + g(x(t),t) dP t y , • ^ (?6) 

give^ the same transition densities as does the Kolmogorov diffusion^ 

equation. If (11.3 6 ) is interpreted in the Stratonovich sense, the 

" / f 
relationship bit wean a(x) and b(x) and f (- ) , g(*) is sjightly more complex 



(see Jazwinski 197^:131), The main point is that the two interpretations 
disagree on this fundamental issue,. Mortensen (1*969:279) summarizes the 



issues as forlows 



11 . . . the situation is that the one "unambiguous way to specify 
a Markov process is to specify its transition density, or 3 :■' 
equivalent ly, the Fokker^ Planck equation obeyed' by the 
transition density, The divergence arises when one wishes 
to generate the specified process as a solution to a stochastic 
differential equation forced Ify the differential o£ a Weiner 
process [ i. e , dw(t ) ] , The divergence boils down to two different 
ways of associating the coefficients in the Fokker- Planck equation 
with tfhe coefficients in the stochastic, differential equation, and, 
respectively , two ways of integrating this ^stochastic equation. 
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oi bourse /^C he r*e is /nto jjisagreement ' confeirfiirfg the relationship 
SDE f s. .ta diffusion equatio.ns. Consider tba* Browniari, motion 
process flithP drff^M* and v ar i anc ©""ff^ £ t^ienkt h e 'forward aquation ^ 
evident ly^~ts : i - <j * ■ . . • - 



of line 



. m. 9£» + I a 2 4-2, 

dt ~ ^ 3x 2 ■ dx 2 



with^initial co^d^tion: f 
" \ lira pCkq) t Q ;x,t) - 6(x-x 0 ) 



(37) 



(38) 



r ■ 



where 6 is the Dirac delta/ funct-ion. * The latter is just a formal way of ? in= 
die at ing tifttat the probability mass at t^ is all concentrated on .the point Xq. 
Assume that the boundaries are the natural ones: Jf > ' v f~ < 



r. 



P(x 0 ,t () ; ".O = Oj p(x Q ,t () ; -«,t) = 0 



(39) 



which state that the process cannot move an infinite amount in finite time. 
Subject to v these conditions* we ^may^solve the partial differential equation 
for, p. \K 

Following Cox and Miller (1965 ;209t10) we simplify the problem by 
making a change of variable using the known solution from Section 3* 



^f(t) = X(t) - X Q - 

at -. 



which gives us the forward 'equation 

dp _ 1 q p 



(40) 



if 



(41) 



-at 2 dx z 

where p = p(y 5 t) is now the probability transition density of the Y(t) 
process with ?(0) - 0, Use the moment generating function of Y(t): 



-M(°;t) - E(e _eY(t) ) ■= J p(y,t) 

which, according to (41) satisfies 



e ^dy 



(42) 



v v 
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with initial condition M(9,0) = I. Thtis 

-' ' " ' ' 

4 M(9' f t) * e . - ( . , *(44) 

i ' * " ' * j / 

which Is the moment generating^ function of a normal distribution with 

mean zero and^ariatice t . Transforming back to X(t), we see that 

X(^ ) ^ N(M-t , a?t ) as Cq found earlier by using the SDE. 

• .. " ^ ' : 

- As ip re ly heavily in later chapters on generalizations of the 

■i ! ' • * . f 

"'■ OU process ,• \ 

'I , ' dX(t) = 0)f(t)dt + J% / (45) 

we sketch »its solution ^Cagain following, Cox/ and Miller) by means of the 
* diffusion equation. The forward equation for this OU process is 



o t n ox 2" d x 

Its m.gifi 



i; t) -J e p(x, t)dx 



sat isf ies 

60 P0d0 + lJ 2 9 2 0 
dt = ax 2 

This is simpler to use expressions in the cumulant generating 
function K(Qj t) = log 0(8; t) ; 

P 1 

at dtJ . 2 

The solution of (49) for 'X(O) = X Q is 




t48) 



(49) 



K(9; t) - X e bt B + o 2 q - e 2bt )()e 2 ) . (50 ) 

• 2b 
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* "H* ^i&VTfi'is last equation" Implies, that X(t) Is normally distributed with 
V ' and this too agrees witf^Dur earlier calculations/ 



(51) 



( 



An Example 



In Part I we noted that social scientists tfften study distributional 
consequences of social structure. We added that only a stochastic perspec-r 

j ! 

tive lends a* systematic treatment to syich issues. Thus in choosing a 
substantive example of the possible sociological applications of SPI's 
and diffusion models we have chosen -one that concerns a distribution 
that arises frequently in social data: the lognormal distribution* ----- 
Our choice has also been guided by an interest in illustrating the 
possible value of pursuing the study of nonlinear SDE's, 

6 

* • 

We start the example by considering a stochastic treatment of ex- 

■ :.-.v i 

ponentiaj, population growth, This corresponds to taking the de term in is tic 
Malthusian model compound r interest model and incorporating random en- 
vironmental factors that perturb the growth rate. The modern treatment 
of this issue begins with Leowontin and Cohen (1969) and Levins (1969), 
It was extended by Capocelli and Ricciardi (1973) and Tuckwell (1974) among 
others. ■ 

Let N(t) denote the size of some population, Then exponential 
population growth follows (as we saw in Part I) from 
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rameter an^ 

Suppose, however, that r(t) varies randomly over-time 
due to a variety of independent environmental variations. We might 



In the deterministic treatment , r(t) is a, constant pa 
N(t) * N Q e rt 



begin by considering r (t ) to be a white no rs e . Then the appropriate SDE 



can 



written 



where P^ is a Brownian motiSn process 



dN(t) = N(t) dP t (53) 

Note that this equation is non- 
linear since g(.) ^ U(t), ? a function of P^ . Rewrite (53) as 

dN(t) ' - dp 



and integrate from t to t: 

' >K<) 

' Acs' N Q 



(54) 
4 



'0 



kfid we have seen, repeated iy that 

* 1 r t "[ 



J dS t - 0 , E \ dp. 



= o\.t 



Thus it follows that log (N(t)/N Q ) has a normal distribution with mean 

2 ' . - - 

zero and variance a"t s That is, N(t) has a lognormal distribution . 

It is a simple matter to add "drift" to this model, allowing the 

average growth rate to be m. (which may , depending on the problemj be. 

/ 

positive or negative), Similar calculations give 

-I 



p(H 0> tt ; N.t) ~ exp 



-(log - - lit) 
0 



2 

2a t 



(55) 
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or, N(t) kte lognomal distribution with mean \Lt and variance at, 

# That is * # , j 



* 



E(N(t) ) - N 0 e°* + ■ (56) 

? 2 ' ' • k /~~" 

w * 2 2ut a r a t * ' ! "'■ 

Var(N(t)) = N Q ef P e c (e -1) . (57) 



Next we wish to calculate extinction probabilities 5 that is the 
probability that N(t) will •'hit" zeco , To do so we must use the diffusion 
equations ' And f recall , the Ito and Stratonovich interpretations disagree 
on how to ^relate coefficients of this SDE (53) and those of the 
Koimogorov equations. Both approaches have been used in the ecological 
literature. Levins (1969) follows Ito and Capoeelli-Ricciardi ( 1.973) and 
Tuckwe 11 (1974) follow Stratonovich . It turns out that, on the latter 
interpretation, the probability of ultimate extinct ion is unity if < 0, 
zero when M* >o and .5 when = 0.,; On the Ito interpretation , populations 
may |P extinct with ptobabilit y one even when the average growth rate is 
posit ive-^ (Tuckwe 1 1 1974), So choice of interpretat ion does make a substantive 
difference. And, agreement appears to be mounting among population 
ecologists that the implications of the Stratonovich interpretation are 
substantively more reasonable for this problem, 

It is worth contrasting this formulation with the classic discrete - 
t ime motivation of the lognormal (Aitchison and Brown 1957), According 
to the "law of proportionate effect 11 , the growth (or decline) of any unit 



is a random multiplfe of its existing siz 



e ; 



( 



N(tft - N(t-l) - £(t)N(t-L) (58) 
where £(t) is some well-behaved random process. If the latter is an 

independent,, identically distributed random variable, central limit theorem 



arguments mply that N(t) converges to a lognormal distribution, 3d 

" * 
what -we have shown is that such a conclusion is retained in the limiting 

continuous-tun^ , process. And in the ^tudy of processes 'such asagrowth 



= 0 * ' - ** . ' 

F in personal-' income , growth of size of organisations , etc, the con- . ■" i 

tenuous -time specif icatipn is more' realistic , there* is " no fixed gesta- 

tion period in such processes and increments may occur spor&dic'ally , 

Thus the mathematical structure outlined in this chapter provides a 

potentially useful tool for analysis of distributional features of social 

structure, : : 



This analytic structure ^mav also .b^^^c^ended to more complex dis- 
tributional. issues. The - popula^Xpn ecology literature cited above also 

a \ 

addresses effects of randomness in growth .rates and carrying capacities 
in logistic growth, i.e., properties of logistic growth in random cn- 
vironinents. The results, though necessarily^ more complex, are suggestive 
for^ sociological applications* 

6 * Boundary Behavior of Diffusion Processes 

We mention one final issue thatiinusC be faced in using diffusion 
models in substantive modeling and empirical research. This concerns 
the choice of boundary conditions in solving the Kolmogorov equations. 
In some contexts , where the QUtcome~Hnay take on positive or negative j 
values, it is reasonable to assume that the boundaries .are the so-called 
natural ones , - 50 and * , We use the boundary structure implicitly in 
deriving^resu Its on Brown 1 an" met ion and Oil processes. 

> 

Unfortunately many situations of* interest to social scientists do 

■ V ■ 

not have natural bound ar ies at infinity , This is true of all those 
outcomes that somehow depend upon counts , e . g . , size of an organization^ 
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votes for a party, ate Such variables may npt be negative. Consequently 
any proce s s d e p ic t ing " t he ir U t be re s tr ic t e d~ t o~~t he nan- 

negative half line [0, m l at a minimum. In some cases (e.g. , hours of 
work), there is also a logical upper . limit so that the process is confined 
between two barriers : e.g. [0, a]. The study of processes constrained 
by boundaries is more complek, And we cannot hope to treat the subject 
adequately here* The classic treatment of these issues is by Feller (1971) ; 
a v£ry clear and less technical exposition of ftie issues can be found in 
Bpkin and Yushkevich (1969), 

We will simply illustrate the implications of the most widely used 

barrier specifications for the sort of model we propose as a starting 

i' ■■ 
point for empirical analysis — the 0U proeeis. Consider first } a^sgrbing 

. ' .- • • • * _ \j_ 

boundaries at which the unit is trapped* ,An example is zero population 

size (for population not exposed to immigration) once size hits zercV__ ' 

the population goes extinct s which is merely another way of saying that 

it« is trapped at zero.. Goal and Richier-Dyn (1974; Table 3 ,4) solve the 

simple 0U process 

dx(t) i bX(t)dt + dP t . ; 

" ' " , 2 

where P is a normal Brown ian motion with vafian.ee CJ for the case where ^ 



the process is confined between an absorbing barrier at zero and positive 
infinity. Instead of the simple normal distribution of (28) , the 
transition density is ' 
p(x 0 ,t o5 x,t) .- —^—'1/2 [exp{- [{(x-m(fc) /V(tJ] 2 /l) + , exfifc f% 

I {fx + m(i )/v(t)r/:>}] (5 



4 7 



' < 26 

* ™bt ■ ** ' 2 2 ""2bt 

where m(t) s ^ e and V (t) s (i - a ""). The first exponential 

, .■• . ' ■•• _ 

term in (59) is identical* to that in the unrestricted prooess; the 

second exponential term reflects the probability o s f extinction. 

If instead, the barrier at sero is reflecting / that is the process 

on hitting zero jumps back to its previous level, the transition density 

is = identical to (59) except that the second exponential term is 

subtracted from the first (I.e., the plus is replaced by a minus between 

the two exponential terms (Goel an>d "Richter-Dyn 1974* Table 3,4, Appendix G) , 

Though these densities are not normal, they do not provide, any special 



ebstaOTe to empirical analysis* 'If either specification (absorbing or 
reflecting barrier) is appropriate to the study of change in non^negative 
variables such as size r and labor supply, one may use expressions like C59) 
to form estimators. Goel and Richter-Byn (1974) have collected, results on 
; the transition densities of ^several processes with various combinations of 
upper and lower boundaries^ These permit development of estimators for 
some more complex problem^, In a wide variety of cases, we can obtain 
expressions for densities that permit the formation of estimators for 
dynamic parameters (by maximum likelihood). We return to this issue in 
the next chapter, 

*It strikes us that for many social processes, the appropriate 
specification of a boundary is some combination of absorbing and reflect-, 
ing. Consider hours of work. Individuals may become unemployed for . - 
variable periods (temporarily absorbed at zero) but then return to work, 
It would be extremely useful to specify boundary conditions that permit 

.... ' . " - 
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a unit to be trapped for a period of random length and then be released 

E ' ./ * 
. , _ ; . . s __ I ' . ' - , . * - _ ^ 

, to jump to some new initial nonzero revel, Such a process would combine 

elements of discrete-state and continuous-state specifications . Work has 

begun on such models and the term sticky barrier has been applied to such 

4 *' ■ 

boundaries. Dynkin and Yushkevich, (1969; Ch. 4) give a clear treatment of 

v « t • ■ 

the strategy of forming models with sticky barriers^and results on some 

c .* ' \ 4 

discrete- time models* We have found no sltfple treatment of sticky 

* * * * . f* 

r barriers In continuous- time models. However, the potential value of 
'■ such applications to social research seems sufficiently great that we 

eagerly await further developments on these models, 

* 7* Conclusion 

* What general implications for sociological analysis emerge from this 

avalanche of algebra? The first conclusion we draw is that it is both 
feasible and useful for sociologists to formulate and test stochastic 
models of change in metric variables, tod this conclusion is apparently a 
new one; we have remarked earlier on the apparent . consensus to the contrary. We 
propose that the general class of SDE's driven by Browni an motion serves as 
a convenient and powerful vehicle for joining probabilistic arguments to ■ 
the kinds of substantive concerns discussed in Part I". We might 
begin with linear SDE ' s , e, g, » extensions of Ohrenstein-Ulenbeck process 
models, for which analytic results are obtained readily. In the next 
chapter we present a strategy for analyzing such models with conventional 
panel data, 

V 
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A deeper urid e rs t and ing of the change processes requires attention to 

• • ■ „ ; r V . ' , 

T : • ^ . " • • ; : ^ - — _ 

** ■ ' ■ # . 

the diffusion equations , and particularly to the nature of boundary con- 

d it ions that constrain social processes. Efforts at such deeper study 

also seem likely to* involve us in the study of nonlinear SDE's (and 

diffusion equations that may not have explicit solutions), If so, we 

■ .= = ^ 

should attend to the fc developing literature on the two interpretations 

of such models and form judpients about the fit of these interpretations 

to sociological arguments, * 
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1 " 4 

The process is also referred to> as one with constant spectral density, 
£(u)) s a . . m fact the characterization T, white" plays on the analogy' 
to white light which contains all frequency components and has constant 
spectral density* „ ~ <■• 



2 ' .' 

The adjective formal in this' usage refers to the use of classical rules 

, in calculations to which they do not strictly apply* 



3 . V 
( We argued in the last chapter that the sociological analysis profits 

from a focus, on distributional features of social structure* We show 
by example in Section 5 .that such a focus will frequently lead to ^ 
the specification of non-linear SDE 1 s . *Thus we 1 do not advocate single- 
minded pursuit of the simpler linear case. 



4 _ x 
I wish to thank. Burton Singer for bringing fehis literature to my 

attention, i * " 
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